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METHOD AND APPARATUS FOR RECOGNIZING A 
STRUCTURE TO BE 
APPLIED ONTO A SUBSTRATE WITH MULTIPLE 
CAMERAS . AND DEVICE THEREFORE 



[0001] The present application relates to and claims priority from European 
Application Serial No. PCT/EP2004/0 14697 filed December 23, 2004, titled "METHOD 
FOR THE RECOGNITION OF A STRUCTURE WHICH IS TO BE APPLIED TO A 
SUBSTRATE, USING SEVERAL CAMERAS AND DEVICE THERFORE", the 
complete subject matter of which is hereby expressly incorporated in its entirety. 

[0002] The present invention relates to a method and apparatus for recognizing a 
structure to be applied onto a substrate with at least two or more cameras in accordanc e 
with th e gen e ric part of claim 1 , and a corr e sponding apparatus ther e for e ., , 

[0003] For recognizing a structure to be applied onto a substrate, it has been 
customary to carry out optical measurements , wh e reby fr e quently . Frequently various 
systems for fully automatic testing of the structure, including adhesive and sealing agent 
lines, are used for this purpos e . recognizing a structure to be applied onto a substrate. For 
this purpose, multiple video cameras are directed at the structure to be recognized, 
wher e by and, in addition, an illumination module serving to generate a contrast-rich 
camera image is required. 

[0004] In this context, there is a need for a method for recognizing a structure to 
be applied onto a substrate ferusing at least two or more cameras, whieh- while the 
method i s us e d to monitor monitors with high accuracy and speed while an application 
structure or adhesive line at high accuracy and sp ee d while it is being applied.- In order to 
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provide for error-free monitoring with multiple cameras, it is essential to carry out the 
image analysis of the individual cameras such that the software for evaluation of the 
recorded images can process this data in a suitable fashion. 

[0005] Methe rAnother problem in this context is the line-shaped progression of 
the adhesive line on the substrate si**e ebecause the adhesive line switches from the 
monitoring area of one camera to the monitoring area of another camera as a function of 
the motion of the application facility relative to the substrate. 

It is therefor e the 

[0006] An object of the present invention isto provide a method for recognizing a 
structure to be applied onto a substrate for at least two or more cameras , which . The 
method facilitates the monitoring of an application structure and/or adhesive line at high 
accuracy and speed, in particular during the application of the adhesive line to the 
substrate. 

[0007] Moreover, it4s-an object of the present invention is_to provide a suitable 
apparatus for carrying out the method according to the invention. 

[0008]Thes e objects are m e t with regard to the method by the features of claim I 
and with r e gard to th e apparatus by th e f e atur e s of claim 14. 

[0008] In th e method according to According to the invention, the structure to be 
applied is applied onto the substrate by an application facility and then the structure 
appli e d onto the substrat e by the application facility is monitored by the cameras such 
that at least an overlapping area of the cameras is directed at the applied structure^ 
wh e reby the . The applied structure, in particular the edges of the adhesive line, is 
transmitted on a surrounding track, and wh e reby the surrounding track is predefined such 
that the applied structure intersects the surrounding track after being applied onto the 
substrate - The surrounding track thus-forms a predetermined and predefined area around 
the application facility such that the adhesive line can be monitored independent of the 
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travel of #^arobot andA)r the application faeility-and -. Further, the surround track can 
be analyzed in a simple fashion by means of a-software ? ._ This allows the application 
structure and^or adhesive line to be monitored at a high rate while it is being applied onto 
the substrate, in particular if the cameras are arranged in a fixed position on the 
application facility such as to b e fix e d in position. . 

[0009] Moreover, it is advantag e ous an advantage is if the surrounding track has a 
closed form around the application facility for determining the adhesive line , wh e r e by . 
For, the adhesive line on the surrounding track on the substrate is monitored by means of 
a projection. 

[0010] According to one embodiment, the adhesive line on the surrounding track 
is determined in the form of an essentially circular caliper. A The circular caliper of this 
type-facilitates the further processing of the data recorded on the circular caliper by 
means of a-software that can be implemented and processed advantag e ously due to the 
simple geometric shape. 

[0011] According to another embodiment, the adhesive line on the surrounding 
track is determined essentially in an elliptical ? form, a polygonal form, or as continuous 
lines. 

[0012] If the center point or the center of the surrounding track essentially 
coincides with the site that corresponds to the site projected on the substrate by the 
application facility with regard to the adhesive line, then the adhesive line always reaches 
the surrounding track essentially with a uniform distance independent of the travel path in 
order to be able to monitor even a narrow radius of adhesive application for the 
determination. 

[0013] According to an advantageou s embodiment of the invention, three cameras 
are directed around the application facility on the surrounding track monito r . Each 
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camera monitors the applied structure using one overlapping area te- that is monitored by 
the neighboring camera— eaeh^_ Consequently, at least one or two cameras can 
simultaneously monitor the progression of the adhesive line to be monitored in any 
direction can be monitor e d simultaneously by on e or two cam e ra s,. 

[0014] Advantag e ously, e ac h Each camera monitors a part of the surrounding 
track such that the individual parts of the surrounding track monitored by each of the 
cameras join with the corresponding overlapping areas to form a continuous surrounding 
track that progresses around the application facility as monitoring the are a is monitored . 

[0015] According to an embodiment of the invention, each camera monitors a 
segment of the surrounding track essentially in the form of a circular line forming a 
circular caliper^ In this context, the angle values of the circular line range from 0° to 
360° to form a global coordinate system , wh e r e by . The individual cameras are assigned 
to image one segment of the circular line with adjacent overlapping areas e ach is assign e d 
to the image s of th e individual cameras.^ . This allows errors at the transition from one 
camera to the next camera to be reduced. 

[0016] It is particularly advantageous An advantage is for the angle values of the 
circular line that range from 0° to 360° to form a global coordinate system of the 
individual cameras, whereby a segment of the circular line e ach is assigned to the images 
of the individual cameras - As a result, the progression of the adhesive line can be 
followed by at least one active camera, whereby stat e ments concerning the entire 
adhesive line as well as its position and/or progression can be made by relatively simple 
means. 

[0017] According to a preferred embodiment where three cameras are used , a first 
camera covers a range of angles from 100° to 130°, a second camera a range of angles 
from 1 100f_ to 250°, and a third camera a range of angles from 230° to 10 °, in cas e thr ee 
cam e ras ar e b e ing us e d ^. 
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[0018] Moreover, during the progression of the adhesive line, it is advantageous 
an advantage is to switch automatically from one camera to the next when the adhesive 
line progresses from the segment of a circular line of one camera via the overlapping area 
to the segment of a circular line of a different camera.- As a result, it is feasible to reliably 
follow the predictable progression of the line and/or position of the line , and th e se ar e 
pr e dictabl e accordingly.^ Therefore, fully automatic switching between neighboring 
cameras can occur such that the parameterization times are reduced. 

[0019] Moreover, it is advantageous an advantage is if the edge of the adhesive 
line is determined on a circular line in order to detect th e adhesive lin e around the 
application facility, at any progression, in a defined area.- According to a preferred 
embodiment, the center of the circular line or of the surrounding track essentially 
coincides with the site from which the adhesive emanates to form the adhesive line, 
whereby each camera monitors at least one segment of the circle formed by the circular 
line. 

[0020] Errors at the transition from one camera to the next can be reduced by 
having each camera monitor at least one overlapping area jointly with at least one 
adjacent camera. 

[0021] Advantageously, th e The individual cameras are calibrated in order to 
assign the-an angle assignment of the individual cameras according to the circular caliper^ 
whereby in . In p articular a circular arc of the calibrating facility with marker points at 
0°, 120°, and 240° is used for the three cameras i s used. ^ This allows a global coordinate 
system to be used with regard to the angle assignment for the individual cameras on the 
circular caliper around the application facility to simplify the image processing by the 
software. 

[0022] According to a preferred embodiment of the invention, only a strip of the 
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camera image is processed by each camera in order to form a sequence of images from 
the individual strips of the camera images , whereby th e . The closed surrounding track is 
assembled from the strips of the individual camera images^ By processing image strips 
to form a sequence of images, the image recording frequency can be increased in 
tifle proportion with the data reduction achieved by recording only a strip of the image 
such that the speed of monitoring of the application structure can be increased. 

[0023] The present invention provides an apparatus for recognizing a structure to 
be applied onto a substrate, preferably an adhesive line or adhesive line, for carrying out 
th e m e thod according to the inv e ntion according to claims 1 to 13, wh e r e by at track. At 
least one illumination module and one sensor unit are provided. For this purpos e , th e The 
sensor unit is made up o fi ncludes at least two or more cameras which are provided and 
arranged around the facility for applying the structure, and each afe-camera is directed at 
the facility for applying the structure , wh e r e by . Furthermore, at least one overlapping 
area of the cameras is directed at the applied structure , and whereby th e . The applied 
structure, in particular the edges of the adhesive line, is determined on a surrounding 
track around the application facility and wh e reby . In addition, the surrounding track is 
predefined such that the applied structure intersects the surrounding track after being 
applied onto the substrate. By this m e ans it is f e asible fo r Thus, the travel path of the 
facility over a substrate and/or a travel path of the substrate relative to the application 
facility tecan be monitored at all times and in all directions by means of directing the 
cameras at the application facility by means of the surrounding track. 

[0024] If the axial longitudinal axis of the individual cameras 
es s e ntial ly approximately intersects, in the direction of view, the axial longitudinal axis of 
the application facility, it is advantageous according to a dev e lopment of this typ e an 
advantage is that a narrow area around the application facility can be monitored at a 
suitable resolution and ajiigh image recording rate. 

[0025] [0025] According to a preferred embodiment, individual cameras7-4ft 
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particular 3 (e.g., three cameras?) are arranged at equal distances from each other in the 
direction of the circumference. 

[0026] Advantageou s ly, th e The individual cameras are circuited such that the 
images of the cameras are stored in a sequence of images such that these images can be 
recorded synchronously-and^ in parallel as w e ll as a and in an assigned fashion. 

[0027] For a higher rate of processing of the images recorded by the cameras, k4s 
advantag e ous an advantage for each camera isjo record only a strip of the image and 
form a part of the sequence of images. 

[0028] According to a development of anthe invention, the cameras form a 
circular caliper whose center is formed by the application facility of the structure. In this 
cont e xt Thus , one or more circular calipers can be used thaHo facilitate the determination 
of the edge of the adhesive line on a circular line. 

[0029] Another advantage consists of each camera monitoring a part of the 
surrounding track such that the individual parts of the surrounding tracks plus the 
overlapping areas A form a closed surrounding track that progresses around the application 
facility in the form of a monitoring area on the substrate. 

[0030] According to a preferred embodiment, the individual cameras comprise an 
overlapping area of at least 10° each relative to the next camera. _This overlapping area 
facilitates fully automatic switching between neighboring cameras when the adhesive line 
progresses from the monitoring area of one camera to the nextr-smee . Because the 
selection of the camera is not bound to the robot position or to a time component, but 
rather refers to the actual inspection results, i.e. is based on the arrangement on the 
circular line of the circular caliper and/or the global coordinate system formed thereby. 

[0031] Moreover, it is of an advantage isto use a calibrating disc with individual 
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form elements for calibrating the individual cameras for the assignment of the angle 
assignmen t whereby thes e . The form elements comprise, in particular, an angle distance 
of essentially 10 °. This ° that allows for assignment of the scaling factor, angle 
assignment, and center as well as aradius of the search circle for the individual cameras. 
According to th e inventio n In order to calibrate the three cameras , the calibrating disc 
comprises at least three marker sites that are arranged in a circular arc of the calibrating 
disc e£essentially ai0°, 120°, and 240 °, in order to calibrate thr ee cam e ras. ! 

[0033]Furth e r advantag e ous dev e lopments of the invention ar e the subj e ct of th e 
remaining subclaim s . 

[0032] Advantageous developments of the invention shall be illustrated in an 
exemplary fashion by means of the following drawingSvj. 



[0033] Figure 1 shews- illustrates a schematic side view of an apparatus according 
to th e inv e ntion for application and monitoring of an adhesive line according to an 
embodiment of the invention . 

[0034] Figure 2 shews illustrates a perspective view of the apparatus shown in 
Figure 1 according to an embodiment of the invention of figure 1 . 

[0035] Figure 3 shews illustrates the travel path of the apparatus according to the 
invention for application and monitoring of an adhesive line according to an embodiment 
of the invention . 

[0036] Figure 4 shews -illustrates another travel path of the apparatus according to 
th e inv e ntion with regard to the switching of the-a_relevant camer a according to an 
embodiment of the invention. 
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[0037] Figure 5 is illustrates a view of a single image composed of three image 
strips from three cameras for online monitoring according to an embodiment of the 
invention , 

[0038] Figure 6 illustrates the principles of the design of the software according 
to an embodiment of the invention , 

[0039] Figure 7 shews illustrates a schematic view of a calibrating device 
according to the inv e ntion for calibrating the individual cameras of the apparatus 
according to the invention for recognizing a structure to be applied onto a substrate 
according to an embodiment of the invention . 

[0040] Figure 8 shew sillustrates a schematic view of the adhesive line with the 
circular caliper and the image strip of the individual cameras according to an embodiment 
of the invention , 

{004£}Figure 9 shews illustrates a schematic view of a curved progression of the 
adhesive line and the-monitoring by the circular caliper 

[0041] In the following, th e design of the apparatus according to an embodiment 
of the invention. 

fQQ444 Figures 1 and 2 illustrate an apparatus for recognizing a structure to be 
applied onto a substrate is illustrat e d according to figur e s 1 and 2. 

[0042] R e ference number . Apparatus 10 indicates the sch e matically shown 
apparatus for application and recognition o f applies and recognizes an adhesive line._ In 
the center of the apparatus 10 according to the invention is arranged an application 
facility 1 1 by means of which an adhesive line 20 is applied onto a substrate 30 and/or 
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onto a sheet of metal 30 proceeding from right to left (shown in figr Figure 1). Three 
cameras 12, 13, 14 are arranged at equal distances from each other in a circle around the 
application facility 11, each of which is directed at the application facility 11. _As is 
evident from figure 1, the axial longitudinal axes of the three cameras 12, 13, 14 intersect 
the axial longitudinal axis of the application facility 1 1 just below the substrate 30 such 
that the focus of the individual cameras 12, 13 and 14 is arranged right around the area of 
the application facility 1 1, in particular on a circular line. 

[0043] In the inspection of the adhesive, either the application facility 11 with the 
cameras 12, 13, and 14 or the substrate 30_is moved, whereby the adhesive line 20 is 
simultaneously applied to the substrate 30 by means of the application facility 1 1 , and 
wher e by th e . The cameras 12, 13, 14 monitor the applied structure. For this purpos e , it is 
f e asibl e to mov e eith e r Either the application facility 11 with the cameras 12, 13 and 14 
or the substrate 30 can be moved in order to apply the adhesive line onto the substrate 30 
such as to follow a desired progression - By this means, the cameras 12, 13 and 14 being 
moved along can monitor, independent of the path of travel, as the the adhesive line at4he 
tim e it 20 is being applied .- In fier- Figure 2, the adhesive line 20 progresses from left to 
right and is indicated by a continuous line.- The intended progression of the adhesive line 
20 is indicated by a dashed line to the right of the application facility 1 1 . 

[0044] Figure 3 tkeft shows the progression of the adhesive line 20 as indicated 
by arrows, whereby the direction and/or field of view of the three individual cameras is 
shown in three sites. The field of view of the three individual cameras e ach is indicated 
by a rectangle drawn with a continuous line, a rectangle drawn with widely dashed lines, 
and a rectangle drawn with narrow dashed lines. As is e vid e nt from figure 3, the The 
direction of the individual fields of view of the cameras remains constant at all times 
whereby only the whole apparatus is moved. 
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[0045] Figure 4 shows another progression of an adhesive line 20 , wh e reby it is 
indicat e d in each cas e , which . The field of view that is active^-fc^r is shown by 3 which 
camera having has the corresponding field of view shown as a rectangle is activ e while 
traveling along the adhesive line. In thi s cont e xt, it must b e noted that, on th e on e hand, 
eniy Only one camera is active at one site, and , on th e oth e r hand, two cameras are active 
at another site. This- Which field of view is active, depends on the progression of the 
adhesive line relative to the circular caliper to b e d e scrib e d b e low that is used to monitor 
the adhesive line on the substrate. 



[0046] Figure 5 then shows three image strips which eaeh-represent a relevant 
section and/or strip of an image of the three individual cameras of figure 1. (shown in 
Figure 1). According to the method of the invention, each camera can record }ust-a strip 
of the image in order to reduce the amount of data accordingly such that the recording 
rate can be increased. These individual image strips of the three cameras are then joined 
into an image, whereby the image recording occurs at defined fixed time intervals and are 
independent of the robot control of the application facility. For example, instead of an 
image height of 480 pixels the cameras only record a strip of the image, wh e r e by in s tead 
of an image height of 480 pixels where an image height of approx imately . 100 pixels 
( e.g., 100 image lines) is used. B yAccordingly, by means of this partial scanning 
technique, {i.e^ partial reading-out of the image recording chip?) only small data streams 
are generated such that the image recording rate can be increased several-fold 
accordingly. It is th e r e for e f e asible in . In the data analysis to captur e^ the images of the 
individual can be captured by the cameras synchronously and-in parallel and th e r e for e as 
well as simultaneously and th e n joins them . Then the images can be joined into a single 
image , wher e by th e . The three image strips are arranged one below the other. As a result, 
the three images-j[i.e. the three image strips), are correctly arranged and assigned with 
regard to location and time relative to each other without further ado, and can be 
processed accordingly. This specific image recording technique therefore facilitates 
simultaneous and parallel recording of individual camera images , wh e r e by . Thus it 
becomes feasible to scan this-a_structure just once during the teach-in of a reference 
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application structure, whereby and the images of all the_cameras are stored in a sequence 
of images. 

[0047] Once the images of the three cameras are stored in a sequence of images, a 
parameterization of this- the reference track is carried out as the subsequent step of 
teaching-in the reference adhesive line._ The robot travel path, robot travel time, 
direction, width, and quality of the adhesive line are used in the parameterization. 

[0048] This The parameterization results in a type of vector chain for the adhesive 
line,, which allows to attain the high image recording rate and comparably short partial 
sections (between 11+ and 3 mmV) to be attained. Vectorization has another advantage in 
that the adhesive line, being in the form of a vector chain, can be stored in a camera- 
transcending global coordinate system. 

[0049] As is e vid e nt from the The bottom strip of figwe (Figure 5— ) shows a 
caliper for gray scale value scanning is-arranged around the center of the application 
facility 1 1 in the form of a circular line , whereby th e . The two edge points 21 and 22 of 
the adhesive line 20 are arranged on the circular line7-TMs - as shown in the bottom of the 
Figure. The circular line is subdivided such that a range of angles from -10° to 130° is 
assigned to a first camera, a range of angles from 110° to 250° is assigned to a second 
camera, and a range of angles from 230° to — 10° is assigned to a third camera such that . 
A_gapless coverage is facilitated around the application facility 1 1 by overlapping areas 
of the individual cameras is facilitat e d. ^ From this results the gapless coverage a global 
coordinate system results for the three image strips that can be provided to be Cartesian 
or polar. 

[0050] If the adhesive line progresses out of the field of view of a camera, the 
adhesive line is transiently in the overlapping area of the ranges of angles of the two 
cameras. If the adhesive line then progresses from the segment of the circular line of the 
one camera via the overlapping area to the segment of the circular line of another camera, 
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an automatic switch is made from the one camera to the other camera. This is shownr-m 
particular, in figure 4 by means of the active fields of view of the individual cameras. 

[0Q5 4 ] The advantages mentioned above are attained by the individual cameras 
forming a circular caliper whose center is formed by the application facility 1 1 , whereby 
the search for the edges 21 , 22 of the adhesive line on a circular line proceeds directly 
around the application facility U. For this purpose, it is essential that the individual 
cameras are directed at the application facility 1 1 , whereby the axial longitudinal axes of 
the individual cameras intersect the longitudinal axis of the application facility 11. In 
particular the width of the pair of edges, of the right and the left edge of the adhesive line, 
the mean gray scale value of the projected gray scale value profile between the pair of 
edges, the edge contrast, and the progression of the position are included in the 
calculation by means of an assessment function in the software. 

[0051] A t e ach in run and/or a t e ach in of a ref e r e nc e adh e sive lin e is illustrat e d 
in th e following 

[0052] The teach-in process of the reference adhesive line can be started by the 
user by means of a mouse click on the line which indicates the position of the adhesive 
line. This is sufficient A mouse click on the adhesive line provides for fully automatic 
recognition of apposition and a_direction of the adhesive line in the subsequent camera 
images, sineebecause the image recording rate is sufficiently high and the individual 
images are recorded very shortly after one another, for e xampl e fe.g. every 1 mm to 3 
mm). From the starting point, the adhesive is scanned image by image, whereby the 
adhesive line position and the adhesive line angle detected in the current image are used 
for the upcoming image as a priori knowledge. The fact that the track radii usually exceed 
20 mm , which facilitates fully automatic capture of the adhesive line without a human 
being having to determine and/or assess the image and/or the position of the adhesive 
line. As a result, the search area can be limited which allows, by means of the high image 
recording rate, to calculat e a determination of where the adhesive line will essentially 
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progress in the following image. 

[0053] Figure 6 shows the principles of the design of the software, whereby the 
teach-in run and/or teaching-in run generates the image sequence , which in turn and 
facilitates the automatic parameterization. ThisThe parameterization can be pre-set by the 
user, if applicable, and is -can be used jointly with a progression file for inspection of an 
applied adhesive line during the inspection run. 

[0054] The online monitoring of an applied adhesive line shall be illustrat e d 
briefly in the following. is provided as follows. The application facility 11 (shown in 
figw eFigure 1) applies the adhesive line onto the metal sheet 30, whereby the application 
facility 11 is moved jointly with the cameras over the metal sheet 30. However, a 
kinematic inversion is also feasible, i.e. the metal sheet 30 being moved and the 
application facility with the cameras being arranged to be fixed in position. The applied 
adhesive line 20 is determined and analyzed synchronously and in parallel by the cameras 
12, 13, 14 on the circular line of the circular caliper illustrated according to figur e 5, 



joins these into a single image to form a sequence of images. The image recording rate is 
increased in accordance with the data reduction attained by each camera recording only a 
strip of the image , wh e r e by th e . The individual image strips in the joint image facilitate 
the synchronous^and- % the parallel, as well as simultaneous capture of the three camera 
images , and whereby the . The individual images of the three cameras can be assigned 
directly as a function of location. As a result, online monitoring of the adhesive line in 
real-time is feasible-fcha K which achieves high accuracy at high travel speeds due to the 
high image recording rate both in teaching-in a reference adhesive line and in the 
inspection of the applied adhesive line. In this context, the information concerning the 
adhesive line in the adhesive search area, the angle assignment of the sensor, the adhesive 
assessment, the robot travel path, and the robot travel time are summarized in a 
progression list. 




shown in Figure 5). Each camera records only a strip of the image and 
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£0059}According to an embodiment of the present invention, an assessment 
function, in particular (e.g., a fuzzy assessment}, can be used to find the edges of the 
adhesive line. In order to determine and assess the adhesive line, the following 
parameters are included in the calculation of a fuzzy assessment: 

[0055] _Width of the pair of edges (edg e e.g., 1 : left edge of the adhesive line, 
edge 2: right edge of the adhesive line)}); mean gray scale value of the projected gray 
scale value profile between the pair of edges ? ; edge contrast ( e.g., g eometric mean of the 
amplitudes of the two edges);}; and progression of position ( e.g., directed deviation of the 
center between the two adhesive edges from the center of the search area, in pixels). By 
The adhesive line can be recognized automatically and described very accurately and 
reliably by means of the plurality of parameters, and the use of the fuzzy assessment 
function , th e adh es iv e lin e can b e d e scrib e d v e ry accurately such that the adh es iv e line 
can b e r e cogniz e d automatically in a reliabl e fashion. . 

[0056] The- An illumination module (not shown here) for the apparatus according 
to the invention is made up of LEDS, in particular includes light emitting diodes (LEDs),, 
such as infrared LEDs, ultra-violet (UV) LEDs or red-green-blue ( RGB-LED§t ) LEDs. 
In order to attain high contrast in image recording, the LEDs can be flashed, (i.e. short, 
strong pulses of current on the order of 1 .0 to 0.01 ms can be applied to the diodes . In this 
cont e xt, ). Thus, the light-emitting diodes are capable of emitting light of various colors 
are particularly advantag e ous ^ such that the sensor design can be switched to other types 
of adhesive and/or colors of adhesives without reconfiguration. 

[0057] Figure 7 shows a calibration facility 40 in the form of a circular calibrating 
disc in order to assign to the individual cameras their scaling factor, their angle 
assignment, and the center as well as the radius of the search circle^. The calibrating disc 
consists of individual form elements and/or dots 41 that are arranged on a circular line 
and at an angle distance of e ss e ntially 10°. approximately 10°. Moreover, marker sites 42 
are arranged at equal distance from each other in order to calibrate the three cameras. A 



15 



Express Mail No.: EB 270750899 US 



QUO1H10/P-W03/US (22589-15US) 



SUBSTITUTE SPECIFICATION - MARKED UP 

compensation calculation is used to calculate from the coordinates of the centers of the 
individual dots, on the on e hand, the scaling factors of the individual cameras and, on th e 
other hand, the center as well as radius of the search area. The marker sites at angles of 
0°, 120°, 240° in the global coordinate system allow the angle assignment and the 
corresponding fields of view of the individual cameras to be determined. The field of 
view of the individual cameras is indicated, in particular, by the three rectangles in figure 
7, whereby the form elements 41 can correspond to the circular line of the circular caliper 
for detection of the adhesive line. 



[0058] According to an embodiment that is not shown, multiple circular calipers 
are formed by multiple cameras that are arranged around the application facility, but are 
attached at different radii from the center of the application facility. For inspection of an 
application structure and/or adhesive line, the cameras are directed at a circle and/or 
circular line whose center coincides with the center of the application facility. The optical 
detection of the adhesive line as illustrat e d above th e n proceeds on this circular line. 

[0059] Figure 8 shows the adhesive line 20 applied onto the substrate by the 
nozzle of the application facility 1 1 . The circular caliper 90 m e ntion e d above that is^ 
provided by the individual cameras to be concentric around the application facility 1 l a is 
used in the analysis of the applied adhesive line 20. The dashed rectangles correspond to 
the image strip of the individual cameras that-is used by the software for analysis. In this 
cont e xt, th eThe rectangle 3 1 is assigned to the first camera as image strip, the rectangle 
32 is assigned to the second camera as image strip, and the rectangle 33 is assigned to the 
third camera as image strip, wh e reby th eThe individual image strips of the individual 
cameras each comprise an overlapping area with respect to the neighboring camera. The 
gray scale value scanning of the circular caliper 90 is carried out by the rectangle 3 1 of 
the first camera (shown in figure Figure 8), whereby in particular the edges shown by the 
small arrows are used for assessment of the quality of the adhesive line , as d e scrib e d 
abov e according to figur e 5. (as shown in Figure 5). Accordingly , in th e case shown in 
figur e 8 , only the first camera is active according to image strip 31 (shown in Figure 8) , 
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as illustrated above according to figures 3 and 4. The circular caliper also extends into the 
overlapping area of the individual image strips 31, 32, 33 such that the two neighboring 
cameras become active in the circle segment of the circular caliper 90-whieh , The circle 
segment resides in the overlapping area of 2 image strips 31, 32, and 33, when the 
adhesive line 20 in this area is shifted and/or progresses due to a track-shaped and/or 
curved progression , as is indicated (as shown schematically by the large arrow in Figure 

[0060] A— Figure 9 shows a track-like progression of this type is shown, in 
particular, in figure 9, whereby the adhesive line in the first position progresses from top 
to bottom and then progresses towards the right in figur e 9 i e.g„ as i s indicat e d shown 
schematically by the second position in Figure 9) . For reasons of clarity of presentation, 
figure Figure 9 does not show the entire rectangle 31, 32, and -33 of the individual 
cameras , but only . But Figure 9 shows the straight lines 310, 320, and 330 that are 
arranged around the application facility 1 1 such as to be fixed in position, sinee because 
the cameras are also arranged around the application facility such as to be fixed in 
position. As a result, the position of the straight lines 310, 320, and 330 does not change 
upon track-shaped progression of the adhesive line with respect to the application facility 
1 1 . Arranged on the circular caliper 90 as indicated by the small arrows (shown in Figure 
9}, the edges of the adhesive line 20 to be monitored thus are made to migrate from one 
image strip to another image strip on the circular caliper 90. 

[0061] MFigure 9 shows in the [upper position of figur e 9J the adhesive line 20 is 
on image strip 32 on the caliper 90 as is indicated by straight line 320r The left edge of 
the adhesive line 20 is in the first position near the straight line 330, whereby only the 
camera assigned to image strip 32 is active. 

[0062] If the adhesive line 20 progresses track-shaped, downwards, and towards 
the right , as shown in figur e 9, the left edge of the adhesive line is first to migrate into the 
monitoring area between the straight line 330 and the straight line 320 such that, as-a 
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result th e reof, aside from the camera of image strip 32, the camera of image strip 33 also 
becomes active on the circular caliper 90. 

[0063] As is shown Figure 9 shows in the second, lower position of figur e 9, both 
edges of the adhesive line ck are at the end of the track-shaped progression in image strip 
33 that is indicated by the straight lines 330 - Consequently, only the camera assigned to 
image strip 330 is still active.- Considering the overall progression, a global coordinate 
system results for the monitoring of the adhesive line 20 due to the circular caliper 90 
being arranged around the application facility 11 , as indicat e d by the The global 
coordinate system tba^is arranged to be constant with regard to the application facility 
1 1 .- Consequently, the software for assessment of the adhesive line 20 must take into 
consideration only the progression on the circular caliper 90. 

[0064] According to an embodiment that is not shown, the circular caliper can 
also be provided by a surrounding track and/or orbit in essentially an elliptical, a 
polygonal form or as continuous lines, for determining the adhesive line by means of a 
scanning g ray scale value scanning. . 

[0065] Therefore, a method for recognizing a structure to be applied onto a 
substrate, preferably an adhesive line, with at least two cameras, in particular three or 
more cameras, is described , wh e r e by th e . The structure to b e appli e d is applied onto the 
substrate by an application facility, and wher e by th e structure appli e d onto th e substrat e 
by th e application facility is monitored by the cameras such that at least one overlapping 
area of the cameras is directed at the applied structure , and wh e reby the . The applied 
structure, in particular the edges of the adhesive line, is determined on a surrounding 
track around the application facility, and-whereby the surrounding track is predefined 
such that the applied structure intersects the surrounding track after being applied onto 
the substrate. 
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